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Convexity of reachable sets of nonlinear 
ordinary differential equations 

Gunther Reifiig 

Abstract 

We present a necessary and sufficient condition for the reachable 
set, i.e., the set of states reachable from a ball of initial states at some 
time, of an ordinary differential equation to be convex. In particular, 
convexity is guaranteed if the ball of initial states is sufficiently small, 
and we provide an upper bound on the radius of that ball, which 
can be directly obtained from the right hand side of the differential 
equation. In finite dimensions, our results cover the case of ellipsoids of 
initial states. A potential application of our results is inner and outer 
polyhedral approximation of reachable sets, which becomes extremely 
simple and almost universally applicable if these sets are known to be 
convex. We demonstrate by means of an example that the balls of 
initial states for which the latter property follows from our results are 
large enough to be used in actual computations. 

1 Introduction 

Reachability problems play a central part in a wide range of control related 
problems, including safety and liveness verification, diagnosis, controller syn- 
thesis, optimization and others [1, 2, 3, 4, 5, 6, 7]. The vast majority of meth- 
ods developed in that context compute approximations of reachable sets in an 
intermediate step [8, 3, 5], which may simplify considerably if the reachable 
set is known to be convex. Consider, for example, an autonomous ordinary 
differential equation x = f(x) with smooth flow ip : U C fx R™ — > IR n , a sub- 
set Q C M. n of initial states and some t\ G M with {tx} x Q C U, and assume fl 
is closed with nonempty interior and smooth boundary dQ. Inner and outer 
polyhedral approximations to the reachable set ip(ti,Q) from Q at time t\ 
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Figure 1: Outer ( — ) and inner (- -) polyhedral approximation of convex 
reachable set. 

are then computed easily. In particular, if v is an outside normal to dfl at 
x G dQ, an outside normal to the boundary d(p(t\, Q) at (p(t±, x) G d<p(ti, fl) 
can be obtained from the solution of the adjoint to the variational equation 
along <p(-,x) with initial value v [9]. Thus, a convex reachable set may be 
efficiently approximated by inner and outer polyhedra up to arbitrary preci- 
sion, see Fig. 1. Similar ideas apply to systems with inputs, e.g. [10, 8, 11]. 
Thus, the question arises under what conditions reachable sets are convex. 

The more general problem of whether the image of a nonlinear map is 
convex appears in the context of optimization and optimal control [12, 13, 14] 
and is related to some geometric problems with a long history [15, 16, 17]. 
Recently, Zampieri and Gorni [18] have obtained a criterion for a local home- 
omorphism between open subsets of real finite dimensional spaces to be one- 
to-one and to have a convex image. They have also shown the image is con- 
vex provided that a certain matrix is positive semi-definite everywhere and 
the local homeomorphism actually is a global C 2 -diffeomorphism. Polyak 
[19] has presented a sufficient condition for the image of a ball under a lo- 
cal C 1,1 -submersion (C l with Lipschitz-continuous derivative) between real 
Hilbert spaces to be convex, from which a duality result and an efficient 
algorithm for nonconvex optimization problems restricted to a sufficiently 
small ball follow. Further sufficient conditions for the convexity of the image 
of convex compact subsets of real finite dimensional spaces under home- 
omorphisms and C^-subimmersions, respectively, have been presented by 
Bobylev, Emel'yanov and Korovin [20] and Vakhrameev [21]. 

Consider now the control system 

x = f(t,x,u(t)), (1) 
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where / : U CMxR n x IR m — » M. n and u is from a set W of admissible controls, 
and denote the reachable set of (1) from Vt C W 1 at time t\ by lZ(ti, O), 

72.(ti, Q) = {</?(ii) | </?(0) G and [0,ti] -> M n is a solution of (1) for some it e U} . 

A result of Plis implies that, under suitable assumptions, which include con- 
vexity conditions on Q and on images of f(t, x, ■), the reachable set lZ(ti, Q) 
is convex for sufficiently small t± > [22]. Lojasiewicz improved upon that 
result by giving an explicit upper bound on t\ [23]. For prescribed t± > and 
Q a singleton, Polyak has shown under different hypotheses that TZ(ti,Q) is 
convex if U is a ball of sufficiently small radius in the space of square in- 
tegrable functions [0, ti] — > M m [24]. Recently, Azhmyakov, Flockerzi and 
Raisch [25] have presented a related result for a closed-loop variant of (1) to 
which we give a counterexample in section 4. Further sufficient conditions 
for convexity of the reachable set of (1) are known for rather special classes 
of right hand sides of (1), e.g. [26, 27, 28]. 

When applied to the problem described at the beginning of this section, 
the results from [22, 18, 19] cited above ensure that the reachable set (p(t\, f2) 
is convex if Q is a Euclidean ball of radius r, and t\ [22, 23] or r [23, 18, 19] 
does not exceed some bound. However, that bound could be extremely small 
and of no practical value, as is the case with the reachability problem studied 
by Polyak [24, p. 262]. 

In this paper, we present a necessary and sufficient condition for the 
convexity of the reachable set of the ordinary differential equation (ODE) 

x = f(t,x) (2) 

from a ball Q of initial values. (Note that the uncertainty comes from a set 
of initial values only. In contrast to the control system (1) investigated in 
[22, 23, 24], there are no inputs to (2).) In particular, convexity is guaranteed 
if Q is sufficiently small, and we provide an upper bound on the radius of f2, 
which can be directly obtained from the right hand side / of (2). We also 
demonstrate by means of an example that the balls of initial states for which 
our results imply the convexity of the reachable set are large enough to be 
used in actual computations, such as in local programming techniques [19] 
and polyhedral approximation of reachable sets discussed at the beginning 
of this section. Our results extend those in [29, 30, 31]. 

The remaining of this paper is structured as follows. After having intro- 
duced basic terminology in section 2, we establish a criterion for the convexity 
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of a sublevel set f2, 

n = {x eU\g(x) <0} , (3) 

in terms of generalized second-order directional derivatives of g in section 3, 
where g: U C X — > R is of class C 1,1 and X is a real Banach space. We also 
present a criterion, rather than a sufficient condition, for the image F(Q) of 
under a C 1,1 -diffeomorphism F to be convex. In section 4 we investigate 
reachable sets from a ball f2 of initial states through solutions of the ordinary 
differential equation (ODE) (2), where f:U C I x I -y I is continuous 
and X is a real Hilbert space. We establish a sharp upper bound on the 
radius of Q that ensures convexity of the reachable set under the assumption 
that / is of class C 1 ' 1 with respect to its second argument and also present 
a necessary and sufficient condition for convexity under the assumption that 
/ is of class C 2 with respect to its second argument. In section 5 we apply 
our results to the equations of the damped mathematical pendulum. 

The reader will notice that stronger smoothness assumptions than those 
adopted in this paper would have simplified both notation and arguments 
considerably. However, such simplification would have come at the expense 
of narrowing applicability of our results since many commonly used models 
of physical systems involve C 1 ' 1 -functions that are not of class C 2 , e.g. [32, 
Sec. 9.1]. On the other hand, if we had weakened smoothness requirements 
further, beyond C 1 ' 1 , certain geometric properties of the boundary of Q and 
F(Q), respectively, that are related to curvature, would have become lost. 
See also the short discussion at the end of section 3. To conclude, we believe 
that for the problems investigated in this paper, C 1 ' 1 -smoothness of both 
maps and sets is a rather natural assumption. 

2 Preliminaries 

Throughout this paper, "iff" abbreviates "if and only if", and X and Y 
denote real Banach spaces with norm || • || unless specified otherwise. B(x,r) 
and B(x, r) denote the open and closed, respectively, ball of radius r centered 
at x, and the space of continuous linear operators X — > Y is denoted by 
C(X,Y). 

M. and 1R + denote the field of real numbers and its subset of nonnegative 
real numbers, respectively, and [a, b], ]a, b[, [a, b[, and }a, b] denote the closed, 
open and halfopen, respectively, intervals with end points a and b, a < b. 
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sign denotes the signum function. We write y > x and x < y for x, y G M n if 
y - x G R£. 

The domain of a map / is denoted by dom /, fog denotes the composition 
of / and g, (/ o g)(x) = f(g(x)), id denotes the identity map, f~ x is used for 
the inverse of / as well as for preimages, and ker / denotes the nullspace of 
/ if / is linear. If L is fc-linear, we set Lh k := L(h, . . . ,h). 

Arithmetic operations involving subsets of a linear space are defined 
pointwise, e.g. aM := {ay \ y G M}, M + N := {y + z \ y G M, z G N} if 
a G E and M,#CI. dM denotes the boundary of M C X, and dimM 
denotes the dimension of a linear subspace M C Jf . 

-D J '/ denotes the derivative of order j of /, and Z}| /, the partial derivative 
of order j with respect to the ith argument of /, and Dif := Djf, f : = 
Df := -D 1 /, and /" := D 2 f . C k denotes the class of k times continuously 
differentiable maps, and C*' 1 , the class of maps in C k with (locally) Lipschitz- 
continuous fcth derivative. Let U C X be open. /: t/ — >• K is a submersion 
at x e C/ if / is of class C 1 on a neighborhood of x and /'(sc) is surjective. 
/ is a submersion on V C [/ if / is a submersion at each point x G V. A 
K-submersion is a submersion of class if whenever if is one of the classes 
of maps defined above. 

For / : U C Jf — >• M of class C 1 with [/ open, we define the four generalized 
second-order directional derivatives D±f and Z?±/, 

r.2 ,/ , ,n , r f , (x + th)k-f'(x)k 

D_lf(x, h, k) = limmf ^ '- v ' , (4) 

n 2 fc M i- f'(x + th)k-f(x)k f 
D±f(x, h, k) — hmsup , (5) 

±40 * 

for all x G £/ and all h,k £ X. If is any of the operators defined above, 
we note that T> 2 f is positively homogeneous in both its second and its third 
argument and define V 2 f(x,h 2 ) := V 2 f(x,h,h). Furthermore, it is easily 
verified that 

Dlf(x,-h,-k) = D 2 _f(x,h,k), 
Dlf(x,-h,-k) = D 2 _f(x,h,k). 

2.1 Proposition. Let U C X be open and convex, f ': U — ?• 1R 6e of class C 1 , 
and let T> 2 be one of the four operators defined in (4)-(5). Then f is convex 
iffV 2 f(x, h 2 ) > for all x G U and all h G X. 
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For these and related concepts and results, see [33, 34] and the references 
given there. 

Let / C R be an interval, U C / x X be relatively open in / x X, the 
map f'.U — > X be (locally) Lipschitz-continuous with respect to its sec- 
ond argument and continuous, and V C {(r, t, x) Glxlxl|(t,i) G 17}. 

: V — > X is called the general solution of (2) if for all (£ , %o) G 17, </?(•, to 5 ^o) 
is the maximal solution of the initial value problem composed of (2) and the 
initial condition x(t ) = x [9]. The map (t,x) H- f(t,0, x) is called the flow 
of (2) if if is the general solution of (2) and (2) is autonomous. 

Let now X be a Hilbert space with inner product (-|-). Two vectors x 
and y are perpendicular, x _L y, if = 0. ||x|| and L* denote the norm of 
x and the adjoint of the linear map L, respectively, with respect to (-|-). We 
define continuous maps fi± : C(X, X) — > R by 

H-(A) = ini{(Ax\x) | ||x|| = 1} , 
fJ>+(A) = sup{{Ax\x) | = 1} . 

The following result is sometimes referred to as Wazewski's inequality. Its 
proof given in [35] carries over to the Hilbert space setting. 

2.2 Proposition. Let I CI be an interval, A: I — >■ C(X,X) be continuous, 
and x: I — )• X be a solution of x — A(t)x. Then 

llz^He^"-^* < ||z(t)|| < Hx^lle^^-^* 
for all t, to G / with t > t . 

3 Convexity of images of sublevel sets under 
diffeomorphisms 

In this section, we present a necessary and sufficient condition for the con- 
vexity of the image F(Q) of a sublevel set Q from (3) under a diffeomorphism 
F. We assume that both the map g from (3) and the diffeomorphism F are 
of class C 1,1 ; see our remarks at the end of section 1. We therefore use the 
generalized derivatives defined in (4)-(5); the corresponding differentiation 
operators are denoted D throughout this section. 

We first present a characterization of the convexity of sublevel sets on 
which our subsequent results are based. Note that the requirement that Q 
be closed is automatically met if U = X. 
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3.1 Theorem. Let U C X be open, g: U — > M. be continuous and a C 1,1 - 
submersion on its zero set, and let Vt defined by (3) be closed and connected. 
Let further T> 2 be one of the four operators defined in (4)-(5). 
Then Q is convex iffV 2 g(x, h 2 ) > for all x £ dQ and all h £ ker g'(x). 

Proof. Assume dQ ^ without loss and observe that our hypotheses imply 
(7~ 1 (0) = dQ. Let us call /i: W — > M a representation of dQ about x in Z 
with respect to the direction v if x £ dQ, v £ X, W C kerg'(x) is a convex 
open neighborhood of the origin, and there is an open interval V containing 
the origin such that Z = x + W + Vv and fi(h) £ V for all h £ W, and 

Znn = {x + h + Xv\h £ W,X £ V,X > fi(h)}. (6) 

An application of the implicit function theorem to the equation g(x + h + 
Ai>) = for h £ ker (/(x) and A £ R shows that for all a; £ 9f2 and all w £ X 
with g'(x)v < there is a representation /i of dQ about x with respect to v 
that is of class C 1 and fulfills 

^f-^rv^ (7) 

for all h £ dom/i and all £ £ kerg'(x), where dom/i denotes the domain of 
H and 

= x + h + v/i(h). 

Let /i be such a representation. It follows from (6) that Z C\Q is convex iff 
fi is; see [36] for a proof of an analogous result on epigraphs. Further, (6) 
yields g'{x)v < 0, and (7) implies that \i is actually of class C 1 ' 1 . We prove 

V 2 »(h, e) = - {9\p{h))vT l V 2 g (p(h), ( P '(h)0 2 ) (8) 

for all h £ dom/i and all £ £ kevg'(x), which is the key relation. 
Let V 2 = D 2 + . For h = 0, (8) reduces to 

Uminf g^±ji±M^ = UmiDf g^±jQI (9) 

40 t 40 t 

since /i and are continuous, g'{x)v < 0, and g'{x)£ = 0. As g' is uniformly 
Lipschitz-continuous in a neighborhood of a; and /x'(0) = we obtain 

lim + ^ + H^QK ~ ± ^ - 
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which implies (9). Therefore, for T> = D 2 ^ 



{g>{y)vy l V*g (y,( 2 ) 



(10) 



for all representations k of dVt about y with respect to the direction v and 
all ( G ker g'(y). For the other three operators defined in (4)-(5), (10) is 
obtained in exactly the same way. 

Let now h G dom/z be arbitrary, let P be the projection operator along v 
onto ker g'(x), let y = x + h + vfi(h), and define k on a neighborhood of the 
origin in ker g'(y) by vk(s) = vfi(h + Ps) — vfi(h) — (id— P)s, which implies 



for all ( G ker g'(y). Choose convex open neighborhoods of the origin 
W C ker and V C R such that Z' := y + W' + W C Z and k(s) G V 
whenever s G W'. It is easily verified that the restriction of k to Z' is a 
representation of dfl about y in Z' with respect to v. Hence, (11) and (10) 
for ( = p'(h)£ give (8). 

With (8) at our disposal, we are now in a position to prove the theorem. It 
follows from (8) that V 2 g(x, h 2 ) > for all x G <9f2 and all h G ker g'(x) iff 
for all x G dQ there is a representation fi of dQ about x with V 2 fi(h, £ 2 ) > 
for all h G dom/i and all £ G kerg'(x). By Prop. 2.1, the latter condition 
is equivalent to the convexity of /i, which in turn is equivalent to the con- 
vexity of Z fl Q for some neighborhood 2 C I of i. As is closed and 
connected, application of a (generalization of a) theorem of Tietze-Nakajima 
[37] completes the proof. □ 

The criterion for the convexity of the set Q presented in Theorem 3.1 takes 
the form of a condition on the map g that defines Q. In finite dimensions, 
i.e., if X = M n , the oriented distance function of Q is a C 1,1 -submersion on 
its zero set under our assumptions [38], and hence, is a natural choice for 
the map g in Theorem 3.1. However, the condition presented in Theorem 
3.1 actually describes metric properties of the boundary of Q rather than 
properties of maps defining Q. In particular, if X = R n and the map g is of 
class C 2 , then V 2 g(x, h 2 ) = g"(x)h 2 , and the restriction of g"(x) to ker g'(x) 
coincides with the second fundamental form [39] of dQ at i up to a positive 
scalar factor. Hence, Theorem 3.1 implies the following well-known result: A 
closed, connected set of class C 2 is convex iff the second fundamental form 
of its boundary is positive semi-definite everywhere. 



v 2 K(ox 2 )=v 2 ^h, (PQ 2 ) 



(ii) 
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Next we present a criterion for the convexity of the image of a sublevel set 
under a diffeomorphism. Note that the requirement that F(Q) be closed 
is automatically met if Q is compact or V = Y. We do not assume that Q 
itself is convex. 

3.2 Theorem. Let U C X and V C Y be open, g: U — > R be continuous 
and a C 1,1 -submersion on its zero set, let Q defined by (3) be closed and 
connected, F: U — > V be a C 1,1 -diffeomorphism, and F(Q) be closed. Let 
further T> 2 be one of the four operators defined in (4)-(5). 
Then F(Q) is convex iff 



for all x G dQ and all h 6 ker g'(x). 

Proof. Under our hypotheses, F(Q) is closed and connected, F(dQ) = dF(Q), 
and 



F(Q) = {yeV\f(y)<0} 

for / := goF^ 1 : V -»■ R. In addition, F'{x)h G kerf (F(x)) iff h G ker^'(x), 
for all x G <9fl Therefore, by Theorem 3.1, F(Q,) is convex iff 



for all x G dQ and all /i G ker g'(x), whenever d 2 is one of the four operators 
defined in (4)- (5). We first establish the relations 



Dlf(F(x),(F'(x)h) 2 ) <D_lg(x,h 2 ) - ^ 2 ± (^(x)F'(x)^F(-))(x, /i 2 ), (14) 

D 2 ± f(F(x), {F\x)h) 2 ) > D 2 ± g(x, h 2 ) - Dl(g'(x)F'(x)- l F(.))(x, h 2 ), (15) 

D 2 ± f(F(x), {F\x)h) 2 ) < D 2 ± g(x, h 2 ) - D 2 ± (g'(x)F'(xr 1 F(.))(x, h 2 ), (16) 

D 2 ± f(F(x), {F\x)h) 2 ) > D 2 ± g(x, h 2 ) - D 2 ± {g>{x)F' {x)" 1 F{-)){x, h 2 ). (17) 



Let x G dQ and h G kerg'(x). We assume X = Y, x = F(x) = 0, and 
F'(0) = id without loss of generality to obtain 



V 2 {g\x)F\x)- l F{.)) (x, h 2 ) < V 2 g(x, h 2 ) 



(12) 



d 2 f(F(x),(F'(x)h) 2 )>0 



(13) 



^ 2 t (^(0)F(-))(0,/ i 2 ) = hminf 



D 2 ± f(0,h 2 ) = liminf 



D±f(0, h 2 ) = limsup 



±40 



±40 



f'(th)h 
t ' 
f'(th)h 

f'(0)F'(th)h 



(19) 



(18) 



(20) 



±40 



t 
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Continuity of /' and Lipschitz-continuity of F' imply \im(f'(th)—f'(0))(F'(th)h— 

t->o 

h)/t — 0, hence 

DlgM = limin[ mw = liminf ifim + flW) . 

— ±yv y ±40 t ±40 \ t t J 

(21) 

(14) and (15) follow from (18), (19), (20), and (21). (16) and (17) are shown 
by analogous arguments. 

Assume now F(Q) is convex. Then (13), (14) and (16) imply (12). Con- 
versely, (12), (15) and (17) imply (13) for at least one of the operators defined 
in (4)-(5), and hence, F(Q) is convex. □ 

3.3 Corollary. Let X , Y be real Hilbert spaces, [/CI and V C7 be open, 
F: U V be a C l ' l -diffeomorphism, Q C U be a closed ball centered at xq, 
F(Q) be closed, and T> 2 be one of the four operators defined in (4)-(5). 
Then F(Q) is convex iff 

V 2 (x - a;o|F / (x)- 1 F(-)> (x, h 2 ) < 1 (22) 

for all x G dQ and all h _L (x — Xq) with \\h\\ = 1. 

Proof. Set g(x) := \\x — xq\\ 2 — r 2 , where r is the radius of Q, and apply 

Theorem 3.2. □ 

In contrast to related results in [18, 40, 20], the conditions in Theorem 
3.2 and in Corollary 3.3 are to be checked on the boundary of Q and for 
tangent vectors only. Further, as with Theorem 3.1, the criteria in Theorem 
3.2 and Corollary 3.3 take particularly simple forms if the maps F and g 
are smooth. If F is of class C 2 , the left hand side of (12) and (22) equals 
g'(x)F'(x)~ 1 F"(x)h 2 and (x — x \F' (x)' 1 F" \x)h 2 ) , respectively, and if g is 
of class C 2 , then V 2 g(x, h 2 ) = g"(x)h 2 in Theorem 3.2. 

The following is an immediate consequence of Corollary 3.3: The image of 
a ball centered at the origin under a C 1 ' 1 -diffeomorphism defined on a neigh- 
borhood of the origin in a Hilbert space is convex provided the radius of the 
ball is sufficiently small [18, 40]. The assumption that the diffeomorphism be 
of class C 1 ' 1 rather than merely C l is essential [18]. For C 2 -diffeomorphisms 
the result is obvious [18] and can also be concluded from a well-known result 
on the existence of geodetically convex neighborhoods in Riemannian mani- 
folds; see [41] and also [18, Sec. 6]. Polyak has raised the question of whether 
the result extends to uniformly convex Banach spaces [42]. It does not, as 
the following example shows. 
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3.4 Example. Endow IR 2 with the norm ||-|| defined by ||a;|| = (|xi| p + |x2| p ) 
for some real p > 2, which makes R 2 a uniformly convex space. Then 
B(0, r) = {x G I 2 g(x) < 0} for arbitrary r > 0, where we have set g(x) = 
\\x\\ p — r p . The map g is of class C 2 . For x = (r, 0) G dB(0, r), h = (0, 1) G 
kerg'(o;), e > 0, and F: x (xi + ex\,x<i) we obtain g"[x)h 2 = and 
g'(x)F'(x)~ 1 F"(x)h 2 = 2epr p ~ l . By Theorem 3.2, F(B(0,r)) is not convex, 
no matter how small r and e are. □ 

We finally remark that the assumption in Theorem 3.2 and Corollary 3.3 
that F be a global diffeomorphism on a neighborhood of Q could easily be 
relaxed. 



4 Convexity of reachable sets 

In this section, we investigate reachable sets from a set Q of initial states 
through solutions of the ordinary differential equation (ODE) (2), where the 
right hand side / : U C IR x X — > X of (2) is of class C 1,1 or C 2 with respect 
to its second argument and continuous. We also give a counterexample to a 
related result for control systems recently presented by Azhmyakov, Flockerzi 
and Raisch [25]. For the sake of simplicity, we restrict ourselves to the case 
where Q is a ball and X is a real Hilbert space, so that Corollary 3.3 applies. 

The general solution of (2) is denoted (p throughout this section. In order 
to avoid confusion of ideas, we would like to remind the reader that accord- 
ing to the notation adopted in section 2, operators D 2 and D 3 refer to the 
partial derivative of a map with respect to its second and third, respectively, 
argument, whereas D 2 refers to the second order derivative, and D 2 and D 2 , 
to the second order partial derivative with respect to the second and third, 
respectively, argument. 

Our first result is a sufficient condition for the set of states reachable 
from a ball of initial values to be convex. That condition takes the form 
of an upper bound on the radius of the ball of initial values, which will be 
shown to be sharp later in Corollary 4.4. 

4.1 Theorem. Let I C R be an interval, U C / x X be relatively open 
in I x X , and the right hand side f : U X of (2) be of class C 1 ' 1 with 
respect to its second argument and continuous. Let further Xq e X, r > 
and to,ti G / be such that {ti} x {t } x B(xo,r) C dom<^. Finally, assume 
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there are M x , M 2 G R tfitrf 



Mi > 



M 2 > limsup 




2^ + (D 2 f(r,x))-^(D 2 f(r,x)), ifh>t Q , 
fi + (D 2 f(r, x)) — 2/i_ (D 2 f(r, x)) , otherwise, 
\\D 2 f(r,x + h)-D 2 f(T,x)\\ 



(24) 



(23) 



/ioWs /or a// (r, x) G £7, and define K by 



K(a) 



|*i — *o|, if a = 0, 

(exp(a|ti — t 1) — 1) /a, otherwise. 



(25) 



Then the reachable set ip(ti,to, B(xQ,r)) is convex if 



rM 2 K(M 1 ) < 1. 



(26) 



Proof. Pick arbitrary x G dB(xQ,r) and h J_ (x — Xq) with \\h\\ = 1. We 
show that (22) holds for F := ip(ti,t ,-), which implies <p(ti, t , B(x , r)) is 
convex by Corollary 3.3. To this end, we assume without loss of generality 
to = 0, t\ ^ 0, x = 0, and / = [0, ti] if t\ > and / = [ti, 0], otherwise. 

As / is compact, (p is continuous, and U is relatively open in / x X, we 
may choose 5 > such that (r, </>(r, 0, 0) + h) G t/ for all r G / and all 
h G £(0,5). Then (24) implies 



\\D 2 f(r, <p{r, 0, 0) + h)- D 2 f(r, ip(r, 0, 0))|| < M 2 \\h\\ (27) 
for all r G / and all h G 5(0, 5). 



Pick arbitrary £ > 0. By the relative openness of the domain of tp in 
I x I x X, the continuity of (p and D 3 (p, and the compactness of /, there is 
some neighborhood If C B(0, 5) of the origin in X such that for all w G W 
and all r G / we have I C dom <£>(■, 0, w) as well as the following estimates: 



\\D 3 <f(r,0,w)\\ < (1 + £ )\\D 3 <p(r, 0,0)||, 
||^(r,0,w)-^(r,0,0)|| <£. 



(28) 
(29) 



Define maps Z and A on J x W by 



Z(r, «j) = D 3 <p(r, 0, «;) - L> 3 ^(t, 0, 0), 

A{t, w) = (D 2 f(r, tp{ T , 0, w)) - D 2 f(r, tp{ T , 0, 0))) D 3 ^(r, 0, w) 
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and use the variational equation of (2) along ip(-, 0, w) and </?(•, 0, 0), respec- 
tively, to obtain 

D 1 Z(t, w) = D 2 f(r, cp{r, 0, 0))Z(r, w) + A(r, w) (30) 

for all (r, w) G / x W. (30) is a linear differential equation in Z(-,w), 
and Z(0, •) = 0. Hence Z(*i,w) = £> 3 y>(ti, 0, 0) jj 1 £> 3 y>(r, 0, 0)- x A(r, w)tZr, 
which implies 



iDa^ti.O.O)- 1 ^*!,!/;)!! < 







< 


/'II 



Da^O^)- 1 !! ■ ||A(r, W )||dr 



(31) 



for all w G W. Use the mean value theorem to estimate ||v?(r, 0, to) — 
^(r, 0,0) || and then apply (27), (28), and (29) to obtain 

\\A(t,w)\\ < (l + E) 2 M 2 \\D 3 <f(r,0,0)\\ 2 \H\. (32) 

From the variational equation of (2) along ip(-, 0, 0), its adjoint, (23), Wazewski's 
inequality (Prop. 2.2), and (25) we obtain | J* 1 \\D 3 ip(r, 0, O^IHlA^r, 0, 0)|| 2 rfr| < 
if (Mi), regardless of the sign of t x , so that IIF^O)- 1 ^'^) - F'(0))\\ < 
(1 + e) 2 M 2 K (Mi) |H| for all w G W by (31) and (32). Now let e tend to 
to obtain (22) from rM 2 K(M 1 ) < 1. □ 

The following is an immediate consequence of Theorem 4.1. 

4.2 Corollary. Let U, f , x , r, t Q , t\, M 2 and K as in Theorem 4-1, assume 
there are A_, A + G M that 

A- < ti- (D 2 f(r, x)) < /i+ (D 2 f(r, x)) < A + (33) 

holds for all (r, x) G U, and define M\ by 

f2A»-A„, ift 1 >t , , \ 

M x = { + ' J 1 - °' (34) 
I A + — 2A_, otherwise. 

Then the reachable set (p(t\, to, B(xq, r)) is convex if (26) holds. 

The main advantage of Theorem 4.1 over the results from section 3 is 
that the bound on the radius can be determined directly from properties of 
the right hand side of (2). Note that Theorem 4.1 cannot be obtained from 
applying any of the estimates from the literature [18, 40, 20] to the map 
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F := <p(ti,t , •). In fact, separately estimating ^'(x) -1 !! and gives 
a larger bound in general. 

We would like to comment on our hypotheses. First note that /i_ (A) and 
fi+(A) equal the minimum and maximum, respectively, eigenvalues of the 
self-adjoint part 

\{£ + A*) (35) 

of A if X = W 1 . Hence, (23) and (33) reduce to bounds on eigenvalues of 
(35). If the ball B(xo,r) of initial values in Theorem 4.1 and Corollary 4.2 
is an Euclidean ball, or equivalently, if the inner product (-|-) equals the 
Euclidean inner product (-|-) given by 

n 

(x\y) = ^2%iyi, (36) 

i=l 

then A* is just the transpose A T of A. If the ball B(xo, r) is an ellipsoid 
rather than Euclidean, then there is a symmetric positive definite matrix Q 
such that (x\y) = (x\Qy), from which A* = Q~ l A T Q follows. This shows 
conditions (23) and (33) can be readily verified. 

Second, note that in the Euclidean case, the result of Lojasiewicz [23] for 
the control system (1) applied to the special case investigated in this section 
would result in a similar bound on radii. In fact, apart from some technical 
hypotheses, the sufficient condition (26) for the convexity of the reachable 
set is obtained from [23], with M\ defined by M\ > 2>\\D 2 f{r, x)\\ rather than 
by (23) or (34). This gives a bound on the radius r that is never larger and 
in general smaller than the bounds presented in Theorem 4.1 and Corollary 

4.2 since 2fi+(A) - H~{A) < ^\\A + A T \\ < 3\\A\\. 

Third, note that if U = Ix~R n in Theorem 4.1 or in Corollary 4.2, then the 
condition {ti} x {t } x B(xo,r) C domtp is automatically fulfilled. Indeed, 
it is straightforward to obtain domtp = I x I x W 1 from condition (23) in 
this case. 

Finally, note that condition (24) is just a bound on ||D|/(r, x)\\ in case / 
is of class C 2 with respect to its second argument. For this case the proof of 
Theorem 4.1 can be specialized to obtain a necessary and sufficient condition: 

4.3 Theorem. Let U , f , xq, r, to and t\ as in Theorem 4-1 and assume 
in addition that f is of class C 2 with respect to its second argument. Then 
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<p(ti, t , B(x , r)) is convex iff 
r*i 

/ (x-x \D 3 (p(T,t ,x) 1 Dlf(T,(p(T,t ,x))(D 3 Lp(T,t ,x)h) 2 )dT < 1 

J to 

(37) 

for all x G 8B(xq, r) and all h _L (x — Xq) with \\h\\ = 1. 

Proof. Pick arbitrary a; G dB(xo,r) and /i 1 (2- xo) with ||/i|| = 1. We 
show that the left hand sides of (37) and (22) coincide if F — <p(ti,to, ■). 

As F is of class C 2 , we obtain F' (x)' 1 F" (x)h 2 = D 3 (p(t 1 ,t , x)~ 1 D' 2 ^(t 1 , to, : 
Since D 3 (p(-,t ,x) is a solution of the variational equation, D 3 ip(-,to,x)h 
solves the initial value problem 

z(t) = D 2 f(T,(p(T,t ,x))z(T), 
z{t Q ) = h, 

which implies that D 2 (p(-,t ,x)h 2 solves 

z(t) = D 2 f(r, tp{r, t , x))z{r) + F>\f{r, ip(r, t , x)) {D z tp{r, t , x)h) 2 , 
z(t ) = 0. 

Hence, F' (x)' 1 F" (x)h 2 = $ D 3 tp(r, t , x)- l D 2 f(T, <p(r, t , x)) (D 3 <p(r,t ,x)h) 

□ 

In contrast to the hypotheses of Theorem 4.1 and Corollary 4.2, which 
may be verified by direct inspection of the right hand side / of (2), the 
necessary and sufficient condition for convexity of the image <p(ti, t , B{xq, r)) 
of the diffeomorphism ip(ti,to, •) that is established in Theorem 4.3 contains 
the diffeomorphism itself. The advantage of the latter result over a direct 
application of (the C 2 -version of) Corollary 3.3 is that the second derivative 
of that diffeomorphism does not appear in condition (37). Hence, in order to 
estimate the left hand side of (37) for a particular example of (2), one has to 
study the variational equation of (2) and its adjoint only. That way one may 
obtain bounds on the radius strictly greater than the one given in Theorem 
4.1. This is demonstrated in section 5. 

With the criterion from Theorem 4.3 at our disposal, we are now able 
to prove that the bound on the radius given in Corollary 4.2 is sharp, from 
which the sharpness of the bound in Theorem 4.1 easily follows. 
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4.4 Corollary. Let there be given t\, t , A_, A + , M 2 , r G R, where A_ < A +; 
M 2 > 0, let Mi and K be defined by (34) and (25), and assume dimX > 2 
and rM 2 K(M 1 ) > 1. 

Then there are an autonomous ODE (2) with analytic right hand side f 
defined on R x X such that (33) and (24) hold for all (t, x) 6lxl, yet 
(f(ti, to, .8(0, r)) is not convex. 

Proof. Assume X = R 2 and to = without loss of generality. Since K is 
continuous and A_ < A + we may pick e G ]0, A + — A_[ such that rM 2 K{M\ — 
e) > 1. Set v± = A± =F e/3 and define g and / by 



to obtain ||D|/(r, x) || < M 2 for all x and any a > 0. By our choice of i/± 
and the continuity of eigenvalues, and since |<?'( s )l < a for all s G ffi, we 
may choose a > such that fi_(D 2 f(T, x)), /i + (-D 2 /(r, x)) G [A_,A + ] for all 
x G X. Thus, (33) and (24) hold. 

Direct calculation shows that for x — 0, h — (0, 1), Xo = (— r, 0), and ti > 0, 
the left hand side of (37) equals rM 2 K(Mi — e), and thus, application of 
Theorem 4.3 shows ip(t±, 0, B(xo, r)) is not convex. If ii < 0, set i/± = 
A T ± e/3 and xo = (r, 0) instead to proceed in exactly the same way. As 
K(Mi) 7^ implies t\ ^ t , the claim is proved after applying the change of 
coordinates x h-> x — x . □ 

Recently, Azhmyakov, Flockerzi and Raisch have investigated the closed- 
loop variant 



of the control system (1), where the control set U C R m is compact and 
convex, solutions to (38) are assumed to exist on [0, t\] for any [/-valued 
measurable feedback u and to be uniformly bounded, the right hand side 
/: M. n x R m — y R n is merely Lipschitz-continuous, and admissible controls 
are [/-valued and Lipschitz-continuous [25]. It has been claimed that the 
reachable set 

lZ(ti,x ) = {x(ti) | x is a solution of (38) for some admissible feedback u} 



g(s) = « 2 (2M 2 )" 1 (sin (M 2 s/a)f , 
/(r, x) = (z/_xi + g(x 2 ), v+x 2 ) 



x = f(x, u(x)) 
x(0) = xq, w(x) G U 



(38a) 
(38b) 
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is convex provided ti is small enough [25]. It follows from geometric ideas 
employed in [22, 23, 24] and the present paper, in particular from Example 

3.4 and Corollary 4.4, that such a claim must be wrong. We provide a simple 
counterexample below. 

4.5 Example. Consider the special case 

X\ = u(x), 
x 2 = u(x) 2 , 

s (o) = (0,0), u(x) g [0,1] 

of (38) on some time interval [0,£i]. As the constant feedbacks and 1 
are admissible, we have (0, 0), (ti, ti) G TZ(ti, (0, 0)) for any t% > 0. If 
TZ(ti, (0, 0)) were convex, then (t\/2,ti/2) G TZ(ti, (0, 0)), which implies 
$ u(x(r))dr = h/2 = f* 1 u(x(r)) 2 rfr for some admissible control u and 
corresponding solution x. Hence, the integral J** 1 u{x{t)) — u{x{r)) 2 dT van- 
ishes, and so does its continuous, nonnegative integrand. It follows that 
either tioi = 0ornoi = l, which is a contradiction. So, H{t\, (0, 0)) is not 
convex, which proves [25, Theorems 2 and 3] wrong. It is easily seen that 
the same system is also a counterexample to [25, Theorem 1]. □ 



5 Application 

In this section, we demonstrate the application of the results from section 4 
to the equations of the damped mathematical pendulum, 

X\ = X2, (39a) 
±2 = — cu 2 sin(a;i) — 27x2, (39b) 

where u > and 7 > [35]. Note that the investigation of the convexity 
of reachable sets of more general systems, such as a cart-pole system with a 
piecewise constant control, can be reduced to the autonomous system (39) 
[30]. 

The results of sections 3 and 4 cover the case of images of ellipsoids as 
we have allowed for arbitrary inner products. In this section, we restrict 
ourselves to the case of images of Euclidean balls for the sake of simplicity. 

The above ODE is of the form 

x = f(x), (40) 
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where / : R — > R is given by 



/(*) 



%2 



-uj sin(xi) — 27x2 , 
We first demonstrate a straightforward application of Corollary 4.2: 
5.1 Theorem. Assume u > 0, 7 > and t± 7^ 0, let M\ and R be given by 
Mi = - sign^h + 3 v / 7 2 + (l + w 2 ) 2 /4, (41) 

^ = a; 2 (exp(M 1 |t 1 |)-l)' (42) 

and /e£ </> be the flow of the pendulum equation (39). Then the image of any 
ball with radius not exceeding R under the map <p(ti, •) is convex. 



Proof. From 



f, w = \-u?L( X1 ) -2 T J (43) 



we obtain the minimum and maximum eigenvalues \± = — 7±a/7 2 + (1 + uj 2 ) 2 /A 
of the symmetric part \{f'{x) + f '(%)*) of f'(x). As 

n*)h 2 = L^l^l, (44) 



uj 2 h\ sin(xi) J ' 

Corollary 4.2 is applicable with Mi 7^ and M 2 = uj 2 if the ball is closed. 
The theorem is proved since the image of an open ball under the map </?(ii, •) 
is the interior of the image of the closure of that ball. □ 

The following larger bound on the radius is obtained from Theorem 4.3. 

5.2 Theorem. Let uj,~/, K±,ti, R G R with < 7 < uj, 1 < uj, k± = 

y/u 2 ± 7 2 ; 2«_*! < IX, < t i; 

6ujk + , . 

R = m , 45 

(1 + (w + 7) 2 ) 3/ 2 sinh(K+ti)(cosh(2K+ti) + 5- lOexp(-w)) 

and let (p be the flow of the pendulum equation (39). Then the image of any 
ball with radius not exceeding R under the map <p{t\, •) is convex. 
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Proof. According to Theorem 4.3 it suffices to prove 

((-h 2 , h)\DMr, x )- l r^{r, x Q ))(D 2 <p(r, x )h) 2 ) dr < l/R (46) 

for all xq, h G R 2 with \\h\\ = 1. D 2 (p(-,xo) is an operator solution of the 
variational equation x = f'(<p(t, x ))x of (39) along (p(-, xo), and D 2 Lp(0, xo) = 
id. Hence, by (43), (44), Cramer's rule, and the formula of Abel-Liouville, 
(46) reduces to 

rti 

u 2 / e 2 ^ T sin (<p( T , x )i) {D 2 ^(t, x Q )h)l dr < l/R. (47) 
Jo 

We shall establish (47) under the assumption 7 < uj. The result for 7 = uj 
then follows from a continuity argument. 

1.) In order to estimate the integrand in (47) we investigate initial value 
problems 

x = A p x+( ,A, (48a) 



u(t) 

x(0) = h (48b) 



for continuous u and h > 0, h ^ 0, where 



1 

P -27 



for any p G R. For X(t) := exp(A p t)h we obtain 

Ai(t) = -J-e"* ((/h(k+ + 7) + h 2 )e^ + {h 1 ( K+ - 7) - Me"^) (49) 

if p = u 2 , and Ai(£) = e -7 * (/ii cos(k_£) + «I 1 (/ii7 + Z^) sin(fc_t)) , if p = 
— w 2 . In particular, Ai is positive on ]0, ii[ in the latter case. Moreover, for 
p = tu 2 , (48a) is cooperative as A u 2 is essentially nonnegative [43]. Hence, 
x{t) < \{t) for all t G [0, t±] if u is nonpositive on [0, £j . 

2.) We claim < (D 2 ip{t, x )h) 1 < (exp (4jat) h) l for all t G [0, h] and all 
Xo, h G R 2 with /t > 0. First note that x := D 2 ip(-, xq)H is a solution of the ini- 
tial value problem (48) with p = —uj 2 and u{t) = uj 2 (1 — cos (<p(t, x )i)) Xi(t). 
This implies 



Xi(t)-(exp(A_ w at)/i) 1 = / (exp(A„ w2 (t-r))) 12 n(r)dr (50) 



19 



for all t S R. Let hi > 0, assume X\ has a zero in ]0,£i[, and let s be the 
smallest such zero. Then, by step 1, the left hand side of (50) is negative at 
t = s. On the other hand, u is nonnegative on [0, s], which by step 1 implies 
the integrand in (50) is nonnegative if t — s, and hence, the right hand side 
of (50) is nonnegative at t — s. This is a contradiction, so X\ is positive on 
]0,*i[. 

Observe now that a; is a solution of the initial value problem (48), this time 
with p = u 2 and u{t) = — u 2 (1 + cos (f(t, £o)i)) %i(t). As u is nonpositive 
on [0, ii], application of step 1 and a continuity argument (in h\) completes 
the proof of the claim. 

3.) From step 2, (49), 1 < u, and | (D 2 (p(T, x )h) l | < \\D 2 (f(T, Xo)i,.\\, we 
obtain the bound 



e" 7 



1 \ 3 ^ 2 

r (1 + («+ + 7 ) 2 ) 3/2 ^ 3 ( cosh(K + r) 2 - — - ] (51) 



for the modulus of the integrand in (47). We next show 

g{x) := (l - 5 ze xp(-a)J - (l - x/(a 2 + 1)) 3/2 > (52) 

for all a > 1 and all x G [0, 1]. As g' is monotone decreasing on [0, 1], the 
map g is concave. Therefore, since g(0) = 0, it suffices to show that g(l) > 0, 
i.e., that 

z(a) := ? exp(a) ^1 - (q2 " 1)3/2 ) ^ 1 ( 53 ) 

for all a > 1. It is easy to see that z'{a) is a positive multiple of {a 2 + 1) 5 / 2 — 
a 5 — a 3 — 3a 2 and that (a 2 + l) 5 — (a 5 + a 3 + 3a 2 ) 2 is a polynomial in s 
with nonnegative coefficients if 1 + s is substituted for a. Hence z'(a) > 
for all a > 1. As z(l) > 1 is easily verified, (53), and hence (52), have been 
established for all a > 1 and all x e [0, 1]. From (51), (52) and the fact that 
(1 + (k + + 7) 2 ) 3/2 k; 3 < (1 + (w + 7) 2 ) 3/2 cj- 3 we obtain the bound 

(l + (w + 7) 2 ) 3/2 w~ 3 ^cosh(K + r) 3 - exp(-w) cosh(h; + r)^ 

for the modulus of the integrand in (47), from which (47) follows by integra- 
tion. □ 



20 



lgR lgR 




Figure 2: Bound R on the radius of f2 that ensures convexity of the reachable 
set ip(ti,Q) over t±, where IgR denotes the logarithm to base 10 of R. (a) 
ou — 1, 7 = 0. (b) u — 6.1, 7 = 0.2. (••: numerical bound, - — : bound 
from Theorem 5.1, — : bound from Theorem 5.2, - -: bound from [23].) 

We would like to emphasize that the results we have established in this 
section are of a global type, i.e., the bounds R on the radius of a ball in 
Theorems 5.1 and 5.2 do not depend on the location of the ball in phase 
space. Instead, convexity of reachable sets from arbitrary balls of initial 
states is guaranteed, provided their radii do not exceed R. 

As we have already remarked in section 4, the bound (42) on radii is never 
smaller and in general larger than the bound from [23]. For the pendulum 
equations (39) one can show that these bounds coincide iff u = 1 and 7 = 0. 
In particular, in the undamped case, 7 = 0, (41) reads Mi = |(1 + u 2 ), 
whereas [23] would give the bound (42) with Mi = 3max{l,w 2 }. Fig. 2(a) 
and Fig. 2(b) show the bounds obtained from Theorems 5.1 and 5.2 and 
from [23] in comparison to a bound obtained numerically for two sets of 
parameters, u = 1 and 7 = 0, and u = 6.1 and 7 = 0.2. The latter 
parameters are obtained from a model of an experimental cart-pole system 
when time is measured in seconds [44]. The results show that in both cases, 
the balls of initial states for which Theorem 5.2 proves the reachable sets are 
convex are large enough to be used in actual computations, such as in local 
programming techniques [19] and polyhedral approximation of reachable sets 
discussed in section 1. For the second set of parameters, the bounds obtained 
from Theorem 5.1 and [23] seem to be less useful. 
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6 Conclusions 



We have presented a novel necessary and sufficient condition for the image 
of a sublevel set under a diffeomorphism to be convex. That result has been 
applied to reachable sets from a ball of initial states through solutions of an 
ordinary differential equation, which has resulted in a necessary and sufficient 
condition for the convexity of those reachable sets. We have also established 
an upper bound on the radius of the ball of initial states that ensures the 
reachable set is convex. That bound is sharp and can be directly obtained 
from the right hand side of the differential equation. In finite dimensions, 
our results cover the case of ellipsoids of initial states. We have also demon- 
strated by means of an example that the balls of initial states that result in 
convex reachable sets are large enough to be used in actual computations, for 
example in local programming techniques [19] and polyhedral approximation 
of reachable sets discussed in section 1. 
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